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LARGE COMMUNITIES IN A SCALE-FREE NETWORK 


CAIO ALVES\ REMY SANCHIS^, AND RODRIGO RIBEIRO^ 


Abstract. We prove the existence of a large complete subgraph w.h.p. in a preferential 
attachment random graph process with an edge-step. That is, we consider a dynamic sto¬ 
chastic process for constructing a graph in which at each step we independently decide, with 
probability p € (0,1), whether the graph receives a new vertex or a new edge between ex¬ 
isting vertices. The connections are then made according to a preferential attachment rule. 
We prove that the random graph Gt produced by this so-called GLP (Generalized linear 
preferential) model at time t contains a complete subgraph whose vertex set cardinality is 
given by where a = (1 — for any small e > 0 asymptotically almost surely. 
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1. Introduction 

In recent years, the popularization of computers and of the Internet made possible the anal¬ 
ysis of large ammounts of data. The empiric investigation of real-world complex networks, 
such as the WWW, the network of collaboration and neural networks [3, 10, 17] has shown 
that these networks exhibit a distinct behaviour from the classical Erdos-Renyi model of 
random graphs (see e.g. [2] for the dehnition of the model). In particular, the distribution 
of the degrees of the vertices from these real-life networks obeys a power-law, the so-called 
scale-free phenomenon. 

After these Endings, the scientific community made significant efforts to explain the origin 
of the power-law phenomenon and to construct models capable of capturing the properties 
presented by the empirical evidences. One possible explanation is the phenomenon of Prefer¬ 
ential Attachment (PA), suggested in [3], which states that new individuals in the networks 
preferentially connect themselves to the more popular ones. Nowadays there exists a broad 
literature about PA models; see [5, 7, 8, 11, 20] and references therein. 

Beyond the power-law phenomenon, other important questions arose, some of them about 
the spread of diseases in scale-free graphs and the vulnerability of such graphs to deliberate 
attack; see [6] for an example. In the context of vulnerability, cliques - i.e., complete sub¬ 
graphs - play a significant role. When the attack is completely random, large cliques have 
high probability of remaining connected. On the other hand, deliberate attacks directed 
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towards them represent a threat to the network’s connectedness. Still in the practical con¬ 
text, the presence of certain subgraphs in biological networks, called motifs, is related to 
functional properties selected by evolution [15]. 

Furthermore, the order of the largest complete subgraph provides a lower bound to the 
number of triangles in G, a fundamental quantity to study the so-called global clustering 
coefficient of G (see e.g. [5, 12, 18, 19]). For more works related to cliques in scale-free 
random graphs, see also [4, 13, 14]. 

In this paper, we investigate a random graph model in a class known as GLP (Generalized 
linear preference) in the literature of Computer Science and Physics. Many results are 
known about a variety of random graph models belonging to the GLP class. In [16], the 
author proves convergence results for the maximum degree of a random graph model in the 
GLP class. In [12] the authors stablish the decay speed of the expected value of the global 
clustering coefficient. In [9], the authors hnd lower and upper bounds for the diameter of 
a subclass of GLP, demonstrating that they also capture the small-world phenomenon. In 
[22] the authors analyze degree correlation in many models, including the GLP class and 
compare the theoretical results with networks obtained from empirical data. 

The model here investigated is a modihcation of the PA model in which links between existing 
vertices are allowed. The effect of this alteration has positive consequences. In [7] the authors 
prove that this model obeys a power law with an tunable exponent. Empirically, the model 
also has shown some advantages over other models. In [21] a statistical analysis is made 
comparing real world prediction capabilities between this GLP model and other influential 
network models, such as the Erdos-Renyi, Albert-Barabasi and Tel Aviv Network Generator. 
The results suggest that the GLP process we study in this paper outperforms these popular 
models when the task is predicting or mimicking real-world complex networks. 

Let us briefly describe the process. This model has two parameters: a real number p G [0,1] 
and an initial graph Go- For the sake of simplicity we will consider Go to be the graph with 
one vertex and one loop. We consider the following two stochastic operations that can be 
performed on the graph G: 

• Vertex-step - Add a new vertex v, and add an edge {u,v} by choosing u E G with 
probability proportional to its degree. 

• Edge-step - Add a new edge {ui,U2} by independently choosing vertices Ui,U2 E G 
with probability proportional to their degrees. We note that we allow loops to be 
added, and we also allow a new connection to be added between vertices that already 
shared an edge. 

We consider a sequence {Zt)t>i of i.i.d random variables such that Zt = Ber(p). We dehne 
inductively a random graph process (Gt)t>o as follows: start with Go, the graph with one 
vertex and one loop. Given Gt, form G^+i by performing a vertex-step on Gt when Z^ = 1, 
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and performing an edge-step on Gt when Zt = 0. The resulting process is the object of study 
of this paper. 


The goal of this paper is to investigate the existence and size of large complete subgraphs 
in Gt, which we refer to as communities. We are interested in communities whose vertex set 
cardinality, which we also call the community’s order, goes to infinity as the process evolves. 
With this in mind, we prove the following result: 


Theorem 1 (The existence of a large community). For any e > 0, the graph G 2 t has a 

/I {1~P) 

complete subgraph of order r ’ ^-p , asymptotically almost surely. 


Remark. Making use of an ansatz regarding decorrelation inequalities between the random 
variables that count the number of edges between predefined pairs of vertices, one can show 

that the expectation of the number of triangles of Gt has order t log t. This indicates 

that the largest clique should be smaller than F for any e > 0. We also remark that, 

putting p = 1, the expected order of triangles is log^f, a result that is consistent with [5]. 


Main ideas and organization. Our analysis requires, as a first step, upper bounds on 
the vertices’ degree. The proofs we give in Section 2 for these bounds follow the standard 
arguments involving martingales and Azuma’s inequality to guarantee measure concentra¬ 
tion. We also need lower bounds for the vertices’ degrees, more specifically, we need the 
presence of a large number of vertices having very high degree, which is proven in Section 3. 
Unfortunately, in this direction Azuma’s inequality leads only to trivial lower bounds. This 
is due to the fact that a single vertex may not increase its degree for a long a time with a 
non negligible probability, which obstructs a concentration result as strong as the one given 
by the upper bound. 


To overcome the above issue, we keep track of the random time in which a vertex achieves 
a specific degree k. The main idea here is to identify sets of m consecutive vertices. This 
proceedure justifies the intuitive feeling that, unlike a single vertex, blocks of vertices are 
more stable in the sense that they do not take very long to achieve a desirable high degree. 
We formalize this intuition in Lemma 1 which gives an upper bound for the tail of these 
random times. The proof follows the idea of Lemma 3.1 of [16], which consist in proving 
a stochastic domination of these random times by a function of independent exponential 
distributed random variables. Unfortunately, in our case loops may occur due to the edge- 
step and this fact not only prevents a straightforward application of this lemma but also 
makes its generalization harder. 

With the aid of Lemma 1 we stablish a lower bound for the degree of blocks in Theorem 2. 
A direct corollary of this theorem is the presence at time t of many vertices having degree 
greater than y/i. This is a fundamental step in order to prove Theorem 1, which is done 
in Section 4. The idea is that pairs of vertices with very high degree in Gt cannot remain 
disconnected until time 2t with non negligible probability. Another consequence of Theorem 
2, which we do not make use of here but we must point out, is the existence, w.h.p., of 
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a vertex having degree of order close to the expected maximum degree Vertices of 

high degree play an important roles in the analysis of complex networks. They offer a lower 
bound for the number of paths of size two, which is important for the calculation of the 
global clustering, and they prove themselves useful for upper bounds for the diameter since 
they tend to attract more connections; see Section 3 of [9] for an example. 


2. Upper bound for the degree 


In this section we will establish a simple bound on the probability that a given vertex 
has a large degree. The result will follow from a application of Azuma’s inequality (see 
Theorem 2.19 from [7]). 


Given two positive integers, i and j, we will make a slight abuse of notation and let these 
numbers also denote respectively the i-th and j-th vertices to be added to the process (Gi)t>o. 
The random time in which the j-th vertex is added to the graph will be denoted by Tj^i. 
Given a vertex v, we will let dt{v) denote the degree of v in Gt- 


Definition 1. Since the constant 1 — p/2 is going to appear many times throughout this 
paper, it deserves a special notation. We write 

Cp := 1 - p/2. 


Proposition 2.1. For each vertex j and eacht^ > j the seguence of random variables 
defined as 


(2.2) Zi 

is a martingale starting from t^. 


nh. (1 + ?) 


Proof. We consider the process (Gt)t>o fo be adapted to a hltration Dehne Adfij) := 

dt+i{j) — dfij). It is clear that Adfij) G {0,1, 2}. Furthermore, conditioned on iff, we know 
the probability that Adfij) takes each of these values. So that, assuming that j already 
exists at time t, we have 


E |A4(J)| J-J = 1 . + 1.(1- 


- Crj 


2t 

dfij) 

t 


2t 


i_*k)U2.(i-p).M(^))^ 


2t 


4U 


The information “vertex j exists at time t” can be introduced in the equation using the 
random variable l{Tji=to}- Using the fact that l{Tji=to} is J^to measurable, we gain 

(2-3) E [dt+i{j)l{Tj^i=to}\J ^+ y) ^t(i)l{U,i=to}- 

Dividing the above equation by nl=i (i- + ^) obtain the desired result. 
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Now we prove the main result of the section. 

Proposition 2.4 (Upper bound for the degree). There exists a universal positive con¬ 
stant Cl, such that for every vertex j we have that 


P 


dtU) > Cif 



< 


1 

t^' 


Proof. We define (j){t) := nl=i (^ + ^)- Note that we can write 

dt{j) _ dt{j) 


and by Proposition 2.1 each term in the sum is a martingale. We want to apply Azuma’s 
inequality for each summand, but first we need some bounds on 0. We get the asymptotic 
behaviour of (f by noting that we can express its rule by a ratio of Gamma functions, as 
follows by using the Gamma function’s duplication property: 


t-i 

4>it )=n 


S=1 



r(t + Cp) 
r(i + Cp)r(t) 


And, by property 6.1.46 of [1], 0(f) ~ This means that, for some constant ci > 0, 
(fit) > CipP. 


In order to apply Azuma’s inequality, we must bound the variation of the random variable Zt 
defined in (2.2), which satishes the following upper bound 


(2.5) at := 


since A.dtij) — 2 and dtiJ) < 2t. By the above discussion about 0 we have that aj < 

which implies Yll=to for some constant c' > 0. Then, applying Azuma’s 

inequality, we obtain 



dt{j)'i-{Tj^i=to} 

< 

dt+lij) “ (l + ^) dtif) 

/ 2 + Cp 

0(f + 1) 

0(f) 


(fit + 1) 

0(f + 1) 


(2.6) P 
Note that 


( 


IT 

dtp ij)l{Tj^i=tp}'\ 

1 

0(f) 


0(^o) J 


> A I < 2 exp (—^/2c') . 


dtp ij)l{Tj^i=to} 
0(^o) 


= 0(fo) P(Tj-i = fo) < 0(to) 


-1 


By choosing A = C 2 \Jt^ ^log(f), where C 2 is a sufficiently large positive constant depending 
only on p, we gain 


P dtij)^Tl,t=tp} > C2t'^ 


'log(f) ^ 0(f) 


t, 


i-p 


0(^0 


< 


fior 
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Using the union bound and the asymptotic behaviour of 0, we obtain the result for all 
possibles times to > j- there exists a positive constant Ci depending only on p such that 


P 



dtU)^{Tj,i=to} 


> Cit^^ 




This hnishes the proof. 


□ 


Using the union bound again, we obtain the following result: 

Corollary 2.7 (Upper bound for the maximum degree). Let dmax{Gt) denote the maximum 
degree among all the vertices of Gt- Then, there exists a universal positive constant C 2 such 
that 

P (dmaxiGt) > G2t‘^^V^) < 


3. Lower bounds for the degree 


This section is devoted to proving the results needed to state a useful lower bound on the 
degree of the vertices that entered the random graph early in the history of the process. We 
prove two lemmas that let us control the tail of the random times defined below, before 
proving the main result. Theorem 2. First we need a new notation: 


Definition 2. Fix a vertex j and two integers m,k> 1. 

I 


rp(m) 


inf 

t>i 


dt{i) 


We define the random time 



We also write ■= other words, is the first time that the j-th vertex has 

degree at least k. can then be explained in the following way: assume that we identify 
all the vertices 1 through m, then identify all the vertices m + 1 through 2m and so on. We 
let dt^m{j) denote the degree of the j-th block of m vertices. Then is the hrst time 
that dt^rriU) is larger than, or equals to, k. 


Lemma 1. Lett) < 7 < (c^^ —1). For large enough m G N andk > m and j > ^^ + 1); 

we can construct a seguence pm, of independent random variables, with 


( 3 . 1 ) = 

such that the whole seguence is independent ofTj^,. 


for i = m,..., k, 

o.i^d such that 


P 


( rp{m) 



< P 





+ 


m 

[{j - l)m]99 
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Proof. We follow the idea of the proof of Lemma 3.1 in [16]. But in our context the existence 
of the edge-step demands more attention and prevents a straightforward application of this 
lemma. 


We begin by constructing the /c +1 — m independent random variables rim, --^Vk with distribu¬ 
tion given by (3.1), the whole sequence being independent of the random times T)- 
Observe that 


P 




> t 


rp(m) 

'^j,k 



P 



fcl + T 




(3.2) 


s=k 


ym) 
',/c + l 


> t 


= s) p (T)r = s 


'j,k 


ym) _ 


' j,k 


p (bSi > ‘ = d p (tip = s 


s=A:l+T' 


j,k 


P,k 


oo 

< P (r,^ < + 5; P > t 


S = fcl+7 


tpM _ p tpM _ „ 

^j,k ^[^j,k - ■s 


We obtain an upper bound for the term P (T, 


n{m) 


> t 


p{m) 

'-pk 


= in the following way: once 


the vertex (block) j reaches degree k at time s, we must avoid choosing j at all the subsequent 
steps until time t. We note that there exists the possibility that = in the case 

that we add a loop to j at time but in this case P > t = sj is equal to 0, 

and our calculations remain the same. Noting that at each step r -|- 1 we choose the vertex j 
with probability 

drU) i^-p)drU) 

r 4r2 

and recalling that Cp := 1 — p/2, we obtain, for s > , 


P 


f rn{m) 

y-j,k+i 


> t 


rp{m) 

^3,k 


(3.3) 


We introduce the notation 
(3.4) 



(1 — p)/c^ 

^^2 


t-l 

n 



(1 -p)fc \ 

2(2 — p)r ) 


t-i 

sn 


^ A _ (i-p) \ 

r \ 2(2 — p)k'^) 


(1 -P) 
2{2-p)k^’ 
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Observe that 


Cp/c(l 

1- - -< exp 




< 1 + 


-Cpk{l-dk) 


r + 1 


Cpfc(l-5fc) 


Plugging the above inequality into (3.3), noting that this results in a telescopic product, and 
recalling the definition of rji, we get 

p (fih. > 

Combining the above inequality with (3.2), we obtain 


= P (> t 




LXJ 

p (t,^, > i) < p P > t 

OO 

(3.5) ^ p j'yM ^ j P > t 

s=k 

=p (fi”’ < i‘+’)+p (fir*'’'' > ‘) ■ 


Ti?) = s ) P ( T)'"' = s 




qm) _ 


'j,k 


t(^) = s]p{t;1^> = s 


pM 


Write 


err{k) ;= P . 


By the above equation, we also have, recalling that rjk is independent from both 
and r]k-i, 


(3.6) 


P ( > t) = 


< 


p ( 


> 


P (e'^'“ = ds) 


P T) 


(m) 




oVk-l 


> 


+ err {k — 1) 


P (e’^'' = ds) 


< P > t) + err{k - 1), 


where P = ds) denotes the measure in R induced by the random variable . Proceeding 
in this way, we obtain 


P > t j < P ( exp f ^ r/i j > t J + err(n). 

\ \ i=m / / n=m 

It remains to be shown that the sum of errors is sufficiently small. First we note that: 


m] 


fi”'<«■+■'} = 1 <;»■«(*)>">. 

But for small n and large j the above event is actually empty, since none of the m vertices 
in the j-th block has enough time to be added by the process. In order to the above event 
to be non-empty, we need at least one of the random variables (i„i+7(i), for i G {(j — l)m -|- 










1,... ,jm} to be possibly not identically null. For this, n and j must satisfy the inequality 
below: 

^1+7 > _|_ I ^ > |'('j _ _|_ X]TT7 _ 

A straightforward application of Dirichlet’s pigeon-hole principle shows that 


jm 

U {d. 


1+7 (*) > - 

m 


We note that, if 

(3.7) 

then 


n 77 ,(i+ 7 )cp^^x -h 7 ) log 

— A hi-j—- 

m (i-1) — 


n 


n 


m 


dni+i{i) > — f h s dni+-i{i) > Cl 


ii,(i+7)cp .^( 1 - 1 -^) logn 


U - 1)^ 


But (3.7) is always valid for large n, since (1 + 7 )cp < 1 and j > -|- 1. Since 

i > {j — l)m, Proposition 2.4 implies 


Consequently 




'^^err{n) = err{n) < j——— 


72=1 1 

72=[(j' —l)m+l] 1+7 




which concludes the proof. 


□ 


Lemma 2. For any vertex j and all m, R E , there exists a positive constant c = Cm,R,p > 0 
such that 

E|rAil < cf. 


Proof. Note that we can write 


jm-l 

Tjm,l = 1 + {Ti+1,1 ~ 

i=l 


SO that Tjm,i is distributed as 1 plus a sum of jm — 1 independent geometric random variables 
of parameter p. Recall that a random variable which follows a negative binomial distribution 
of parameters jm — 1 and p has moment generating function 

(1 

By taking the i?-th derivative of Q{s) and evaluating it at 0, one can conclude the Lemma’s 
statement. 1—1 
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Now we state and prove the main theorem of this section. 

Theorem 2 (Lower bound for the degree). Fix m sujficiently large, and let 

1 < R < mCp(l — dm)- 

Then there exists a positive constant c = c{m,R,p) such that, for 

(3 e (0, Cp(l — dm)) and j > + 1 


we have: 


P {dt,m{j) <t^) <c 


aR 


+ 


m 


fR—pR/Cp{l — 5m) \(j — 1)?7T,]®® 


Proof. Fix m sufficiently large. By Lemma 1, 


(3.8) 


(d,,„(j) < r) = v(Tjp >«) < p |r,‘j;’exp I >« j + _7)„] 
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We need to control the hrst term of the inequality’s right hand side. We have that 




t/3 


(3.9) P exp > t = J^P exp > t/n P = n) , 


n=l 


because is independent of pi for all possible values of i. Since pi = Exp(zcp(l — (5i)), we 
have that its moment generating function is given by 

1 


Giis) = 


s ’ 


2Cp(l 


for s < icp{l — di). Then, for 1 < i? < mCp(l — dm), Markov’s Inequality implies 




n 

t^ 


tp 


(3,10) 


< 


n 


R 


tP 


t^ 


n 1 


R/[cp{l - (5,)] 


R/[Cp{l - 5m)] 


-1 


-1 


The last product can be written in terms of the Gamma Function, using its multiplicative 
property. Note that 

tP 


nb 


R/Cp{l -dm)\ _ F(m)F + 1 - R/cp{l - dm)) 


i J V{m-R/cp{l-dm))T{th + iy 

This in turn implies the existence of a constant b = bm,R,p > 0 such that 

tP 


JJ- / _ R/Cp{l 5m) \ ^ 

7—m ' ' 
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Then, combining this bound with inequality (3.10), we obtain 


t/3 


(3,11) 


P I exp 1 ^ > ij n < b 


^R^l3R{Cp{l-Sm)) 




Notice that, by the time that the jm-th vertex enters the graph, the j-th block of m vertices 
has total degree at least m, that is, Tj^ < This fact, together with (3.9), Lemma 2, 

and the above inequality, implies 




>‘l ^ 


(3.12) 


< 


-f^R-l3R{cp{l-5m))~^ 

b 


n=l 

oo 




fR—/SR{cp(l—5m)y 


- ^ n^P = n) 


n=l 


fR-yR(Cp{l-5m)) 


xrE K.J 


Lemma 2 
< 


CJ 


R 


lR-0R{cp{l-5m))-^ ’ 

for some constant c = Cm,p,R > 0. Combining (3.12) with (3.8) gives the desired result. 


□ 


4. Communities in Gt 


We are hnally able to prove the main result of this paper: the existence of a community 
in Gt whose size grows to infinity polynomially in t. 


Proof of Theorem 1. Fix some real number e such that 0 < £ < 1. Let a = (1 — e) , fix 
[3 = choose £' > 0 such that e' < a. These choices of parameter imply that 

l + e2-\l-p) 


(4.1) 

and 

(4.2) 


(9 


/?:= 


^ U + D “ = (2-p) 1 + 


^ (1 


g(l -P) 

2(1 - SJ 


+ (1 -P)(l -£) + 


(1 -P) 
R 


(1 ) Cp \ ^ 

for sufficiently large m and R. By Theorem 2 and the union bound we have that 


(1-e) <1, 


(4.3) 


IJ {dt,m{j) <t^} 


< 


G 


+ 


m 




^R-^J^-aiR+i) (mt) 


98e' ■ 


Equations (4.1) and (4.2) then imply that the right hand side of the above inequality goes 
to 0 as t goes to inhnity. The immediate consequence of this fact is that inside each one 
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of those — t^' blocks of vertices of size m there exists at least one vertex whose degree 
is larger than t^/m, with high probability. We denote by Lj = Lj^m,p the vertex of largest 
degree among the vertices of the j-th block, and we call Lj the leader of its block. As we 
noted, dt{Lj) > /m. 


We now prove that these vertices of large degree are connected with high probability. We 
write i ^ j io denote the fact that there are no edges between the vertices i and j. We 
dehne the event 

B. = U < t”} ■ 

j=t^' 

Let gs{i,j) be the indicator function of the event where we add an edge between Lj and Lj 
in an edge-step at time s. We dehne the random variable 

2t 

Y2I = n 


In other words, is the indicator function of the event where we don’t connect Lj and Lj 
in any of the edge-steps between times t + 1 and 2t. We have that 


(4.4) 


E — g2t{hi))\^2t-\\ — 


< 


(, on 3d2t-i{Li)d2t-i{Lj)\ 

-4(2t - 1)^- ) 

/ ^2/3 \ 


Now, observe that Y 2 I = Y 2 l_i{l — g 2 tii,j))- So, by using (4.4), we obtain 

(4.5) E < (1 - (1 -p)^) htiiBp 

Proceeding inductively, taking the conditional expectation with respect to Ts-i at each 
step s, we gain the following inequality 

(4.6) E [lB^Y^^t\Tt] < (^1 - (1 - < exp {-cit^^-^) iBf, 

where Ci is a positive constant depending on both p and m. Since inG 2 t} — 

above inequality implies 

P (Lj Lj in G 2 U Bl) < exp P {BD . 

Now, by the union bound, we have 

P j IJ {Li^ Lj in G 2 t} , j < exp P (5^). 
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And finally, 


^1 LJ ^ ^2t} ) ~ ^ ( U ^ ^2t} , B 


\t^ <i,j<t°‘ 


\t^ Si,j<t°‘ 


+ P I {Li ^ Lj in G 2 t} , Bt 

\G<i,j<t°‘ 

< exp (-cit"^-^) P {B{) + P [Bt] . 


The above ineqnality, together with onr choice of a, /3, and ineqnality (4.3), imply the 
existence of a snbgraph of Gt with order t"(l — o(l)) asymptotically almost surely. 
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